7. Augmented Reality
Augmented Reality
c.f. Virtual Reality
AR in a narrow sense
Add CG image to real image
CV, CG research
Example of augmented reality
http://gyazo.com/773ae2462931560d4e3b4e93f0c672c5.png
Required Techniques
Add CG image to real image
CG generation
Recognition of real world objects, position recognition
Minimizing latency
3D object recognition
AR in broader sense
Real-world interface
Ubiquitous computing
Integrate real-world info and computer info
With display or without display
Examples
Barcode, RFID
Suica
Wathing a game with radio
Car navigation systems
Pokemon GO
https://gyazo.com/930c4b003a89a1f806a29771c53597d2.png
https://www.youtube.com/watch?v=iQWbc5giC-Y
Trend of "Augmented Reality"
https://gyazo.com/d840b99c395126420acdbf0492a3f84a
20-year Trends
Programmers used "AR toolkit"
Got popular by "Den-no Coil" film
Pokémon GO
Revival by HoloLens from MS, MagicLeap from Google
ARKit on iPhone available
How to add CG to real image
HMD(Head Mount Display)
Optical method
Video method
Monitor method
Projector method
Optical method
http://masui.org.s3.amazonaws.com/b/0/b01f8f8c7ddb9d9426f34eda788c6832.gif
Video method
http://masui.org.s3.amazonaws.com/f/5/f55f7c4f49121ad78b133406b6f85b43.gif
Monitor method
http://masui.org.s3.amazonaws.com/a/2/a298cb4d776098abbf76398e5a2cfa0e.gif
Wireing of airplane
http://masui.org.s3.amazonaws.com/3/9/39c05a4ae66f45092a1dd525215ef391.gif
For surgery
http://masui.org.s3.amazonaws.com/1/5/157c254708adac895edb24c8462a8108.gif
http://masui.org.s3.amazonaws.com/9/1/9140463c8b5c1ec4a9e27adb0f0194e5.gif
Olympus system
Endoscope image + tumor, nerve system, etc.
https://gyazo.com/49fb5af7e70a9f81bb543a058f9ac7c7.png
Karma
Printer maintainance system
http://masui.org.s3.amazonaws.com/0/d/0dfe66559ab4ea24246494f11a51adc0.gif
http://masui.org.s3.amazonaws.com/7/8/786c3fa5edca5d3eb41016f2ebfdb05a.gif
NaviCam
Adding computer-generated info to real image
Barcode recognition
http://masui.org.s3.amazonaws.com/5/6/564d19d00095edc9cfaada7154c09189.gif
http://masui.org.s3.amazonaws.com/7/0/70ba9d18856c75a54dedf9e92470306d.gif
Video: NaviCam
http://www.youtube.com/watch?v=S6XKPEexRbU
NaviCam with 2D barcode
https://www.youtube.com/watch?v=cNFwEMkLK4A
Den-no Coil (animation movie)
People got interested in AR
https://gyazo.com/cdbde78694cbedaa95b2a21469c128d0.png]
Video: Den-no Coil
https://gyazo.com/3e131b3ca0d8f4ee9bb0ec30a6b88b97
Prof. Hirokazu Kato, Mark Billinghurst
1999〜
Sunao Hashimoto at Meiji University
http://hondana.org/%E5%A2%97%E4%BA%95/4048673610 https://gyazo.com/8565dd98143823ef91b3032ed02b38fa.png
AR Toolkit
Use a shape in black frame
https://gyazo.com/a4acc4273131921070560aa1ec837987.png
https://gyazo.com/1710f89d0d46dddfbadd43c9fe771335.png
Computer figure ARis
Entertainment using AR
https://gyazo.com/788ed6a2f3313d09ab84acb2894c5b3e.png
Video: ARis
https://www.youtube.com/watch?v=yCCx7zANsGE
by George Klein
https://gyazo.com/3120a2d5f1e29e4093beb90cedadd0d7.png
Video: PTAM
http://www.youtube.com/watch?v=Y9HMn6bd-v8
Walking Hatsune-miku
https://www.youtube.com/watch?v=PkmjN6eyyHg
Wikitude
Android
GPS + compass
https://gyazo.com/872379f6a5bc710afb7553de2fca0f6d.png
Video: Wikitude
https://www.youtube.com/watch?v=8EA8xlicmT8
By Mr. Kanamachi
https://gyazo.com/6493f9a229bf95b4e4d87473ffdf50e7.png
Video: SREngine
https://gyazo.com/6a1baeb130598dc22b3c90313ff1e45d.png
Video: TwittARound
https://www.youtube.com/watch?v=_Vbh7nHalCc
Subway map
https://gyazo.com/ba57bf7b06da264c2a111fb54fe6eac7.png
Video: subway map
https://www.youtube.com/watch?v=ps49T0iJwVg
Constellation viewer
https://gyazo.com/4a730c80d833341dc3475d2b23d812fc.png
Video: constellation viewer
https://www.youtube.com/watch?v=-mVl5Xd2DAw
Mountain camera
https://gyazo.com/27b08ab05c3488f62c43defc365ab150.png
AR + Magic
https://gyazo.com/60245c53b318e4d42fcb9ebd2e0ca3aa.png]
Video: AR Magic
https://www.youtube.com/watch?v=ZX8MBBohX3s
Prof. Inami
Keio KMD => University of Tokyo (2015/11/1)
Doing research on various AR technologies
https://gyazo.com/998a98607efb92a30a28fbea2a68d5c9.png
Prof. Inami
https://gyazo.com/f4274d9beb4f639c8543542907315abf.png
Video: Bakumon-Gakumon
http://masui.org.s3.amazonaws.com/b/5/b59fa554a6d8d6452a64a9519a6d07f5.mp4
Google Glass
https://gyazo.com/72bc27b1ab8a51cc308edb241a8c2d58.png
Video:
http://www.youtube.com/watch?v=9c6W4CCU9M4
Google Glass
Deveopment stopped
AR for interface systems
DigitalDesk
MetaDesk
PingPongPlus
LuminousRoom
DigitalDesk
Projector + Desk
Recognition of fingers and papers
http://masui.org.s3.amazonaws.com/4/0/40b96c944513f8d03e6b26d7ed8b2877.gif
MetaDesk
Projector-based desk + 'phicons'
https://gyazo.com/3e1d1317a050381e784d8b87be83b1b5.png
https://gyazo.com/af2cfc3a5c3862f41afe5109fb0b8bd4.pnghttps://gyazo.com/441c53304433e149f78cf16ab1a82920.png
PingPongPlus
Projection on ping-pong table
Use microphones for position recognition
https://www.youtube.com/watch?v=AZO8sfmpKIQ
Projector + camera
Simulation of light and lens
https://www.youtube.com/watch?v=gSXszE0Swvg
InFORM
https://www.youtube.com/watch?v=lvtfD_rJ2hE
Video: TRANSFORM
https://www.youtube.com/watch?v=lCARHatJQJA
Pattie Maes
https://gyazo.com/ca690c2e0f39352c0f26457bed4decba.png]
Video: Sixth Sense
https://www.youtube.com/watch?v=YrtANPtnhyg
ARKit
https://www.youtube.com/watch?v=khavGQ7Dy3c
ARKit
https://www.youtube.com/watch?v=GBds_Y9buxY
ARKit3
https://www.youtube.com/watch?v=vkS-VqAss4s
AR by Microsoft
"Windows Holographic" technology
https://gyazo.com/050f36bcdd9bf8956bf40b038f67a1a4
Video: HoloLens
https://www.youtube.com/watch?v=aYdB2xBNFek
Video: HoloLens 2
https://www.youtube.com/watch?v=eqFqtAJMtYE
Very light HMD
Supported by Google
Concept Video
https://www.youtube.com/watch?v=kPMHcanq0xM
Magic Leap
https://www.youtube.com/watch?v=Vrq2akzdFq8
https://www.youtube.com/watch?v=q_8g0H4IksU
Video: Magic Leap
https://www.youtube.com/watch?v=kw0-JRa9n94
Video: Magic Leap
https://www.youtube.com/watch?v=kPMHcanq0xM
Oculus Quest (VR)
Inexpensive HMD (〜50000 yen)
https://www.youtube.com/watch?v=Di7dIhUFsbw
Oculus Quest
https://gyazo.com/3f10e55cb87bfc2580b78851eb4c3711
KAGE
https://gyazo.com/1738a0621424d74f36cfb262c8d1500e.png
Video: Kage
https://www.youtube.com/watch?v=7JNk_lXjxQY
Kobito
https://gyazo.com/e13275e04979dfd97b7f9467f6ad85f9.png
Video: Kobito
http://masui.org.s3.amazonaws.com/4/5/454bc755f2534bd46670eac43765759f.mp4
Summary
Everyone can enjoy AR now
Various new applications
AR visualization will become more popular
End